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ABSTRACT 

An unsupervised software "robot" that automatically and robustly reduces and analyzes CCD ob- 
servations of photometric standard stars is described. The robot measures extinction coefficients and 
other photometric parameters in real time and, more carefully, on the next day. It also reduces and 
analyzes data from an all-sky 10 /im camera to detect clouds; photometric data taken during cloudy 
periods are automatically rejected. The robot reports its findings back to observers and data analysts 
via the World-Wide Web. It can be used to assess photometricity, and to build data on site conditions. 
The robot's automated and uniform site monitoring represents a minimum standard for any observing 
site with queue scheduling, a public data archive, or likely participation in any future National Virtual 
Observatory. 

Subject headings: astrometry — methods: data analysis — methods: observational — site testing — 
sociology of astronomy — standards — surveys — techniques: image processing — 
techniques: photometric 



1. INTRODUCTION 

More and more, astronomical research is being per- 
formed remotely, in the sense that the observer, or perhaps 
more properly "data analyst" , is now often not present at 
the place or time at which observations are taken. The 
increase in remoteness has several causes. One is that 
for many observatories, telecommunication is easier than 
travel, especially if telescope allocations are of short dura- 
tions. Another is that several new telescopes are us ing or 



plan to use qu eue- s cheduling (eg. 



son et al 1996 



contributions to D3oro- 



and P3oroson et al 1998 , parzon fc Roza^ 
19981 , [Tilanus 200q , |A/Iassey et al 200q ), for which observer 
travel is essentially impossible. Some new ground-based 
telescopes are partially or completely robo tic (eg, contri- 
butions to Filipponko 1992 , contributions to [Adelman et a) 
, and Baruch &: da Luz Vieira 1993 , Akcrlof ct al 1999 , 
Castro- Tirado et al 1999| , Strassmeicr ct al 2000, Qucrci & 
Querci 20001 ). Possibly the most important reason for the 



increase in remote observing is that many observatories, 
many large surveys, and some independent organizations 
are creating huge public data archives which al low analy- 
ses by any one at any time (eg, c ontributions to Mehringei 
et aligggj and [Manset et al 2000| ). There has been commu- 
nity discussion of a "National Virtual Observatory" which 
might be a su perset of these arch ives and surveys (eg, con- 
tributions to Brunner et al 2001). 

Remote observing and archival data analysis bring huge 



the significant cost that the observer does not have di- 
rect access to observing conditions at the site. Most re- 
mote observatories and data archives keep logs written by 
telescope operators, but these logs are notoriously non- 
uniform in their attention to detail and use of terminology. 
All sites that plan to host remote observers or maintain 
public data archives must have repeatable, quantitative, 
astronomically relevant site monitoring. 

For these reasons, among others (involving photometric 
calibration and direction o f survey operati ons) the Sloan 
Digital Sky Survey (SDSS; [York et al 200C| ), which is con- 
structing a public database of lO'' deg of five-bandpass 
optical imaging and 10^ optical spectra, employs several 
pieces of hardware for monitoring of the Apache Point Ob- 
servatory site, including a 10- /jm cloud-camera scanning 
the whole sky (Hull et al 1994), a single-star atmospheric 
seeing monitor, a low-altitude dust particle counter, a ba- 
sic weather station, and a 0.5-m telescope making pho- 
tometric measurements of a large set of standard stars. 
This paper is about a fully automated software "robot" 
that reduces the raw 0.5-m telescope data, locates and 
measures standard stars, and determines atmospheric ex- 
tinction in near-real time, reporting its findings back to 
telescope and survey operators via the World-Wide Web^ 
(WWW). This paper describes the software robot, rather 
than the hardware, which will be the subject of a separate 
paper (Uomoto et al in preparation). 



economic and scientific benefits to astronomy, but with 

^Based on observations obtained at the Apache Point Observatory, which is owned and operated by the Astrophysical Research Consortium, 
■^and Institute for Advanced Study, Princeton, NJ 08540 

^and Department of Astronomy, University of Cahfornia at Berkeley, 601 Campbell Hall, Berkeley, CA 94720 
■^Hubble Fellow 

" http:/ /www.w3.org^ ' . 



^Information about the WWW is available at 
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Although the robot is somewhat specialized to work 
with the hardware and data available at the Apache Point 
Observatory, it could be generalized easily for different 
hardware. We are presenting it here because it might serve 
as a prototype for site monitors that ought to be part of 
any functional remote observing site and of the National 
Virtual Observatory. 

2. TELESCOPE AND DETECTOR 

The primary telescope used in this study is the Pho- 
tometric Telescope (PT) of the SDSS, located at the 
Apache Point Observatory (APO) in New Mexico, at lati- 
tude 32 46 49.30 N, longitude 105 49 13.50 W, and elevation 
2788 m. The PT has a 20-in primary mirror and is outfit- 
ted with a 2048 x 2048 pixel CCD with 1.16 arcsec pixels, 
making for a 40 x 40 arcmin^ field of view. The telescope 
and CCD will be described in more detail elsewhere (Uo- 
moto et al in preparation). 

The telescope takes images through five bandpasses, u', 
g', r' , i', and z' , chosen to be close to those in the SDSS 2.5- 
m imaging camera. Filter wavelengths are given in Table ^ 
The magnitude s ystem here is based on an approximatio n 
to an AB system ( pke fc Gunn 1983i [Fukugita et al 19961) , 
again because that was the choice for the SDSS imaging. 
The photometric system will be described in more detail 
elsewhere (Smith et al in preparation). Nothing about 
the function of the robot is tied to this photometric sys- 
tem; any system can be used provided that there is a well- 
calibrated network of standard stars. 

3. OBSERVING STRATEGY 

Site monitoring and measurement of atmospheric ex- 
tinction is only one part of the function of the Photo- 
metric Telescope (PT). The PT is being simultaneously 
used to take data on a very large number of "secondary 
patches" that will provide calibration information for the 
SDSS imaging. For this reason, the PT spends only about 
one third of its time monitoring standard stars. Its site 
monitoring and atmospheric extinction measuring func- 
tions could be improved significantly, in signal-to-noise 
and time resolution, if the PT were dedicated to these 
tasks. 

The observing plan for the night is generated automat- 
ically by a field "autopicker" which chooses standard star 
fields on the basis of (a) observability, (b) airmass cover- 
age, (c) intrinsic stellar color coverage, and (d) number of 
calibrated stars per standard field. Because the observing 
is very regular, with u' , g' , r' , i' , and z' images taken (in 
that order) of each field, it has been almost entirely au- 
tomated. The only significant variation in observing from 
standard field to standard field is that different fields are 
imaged for different exposure times to avoid saturation. 

The raw data from the telescope is in the form of images 
in the Flexible I mage Transport System format (FITS; 
Wells et al 1981). The raw image headers contain the 



filter (bandpass) used, the exposure time, the date and 
UT at which the exposure was taken, the approximate 
pointing of the telescope in RA and Dec, and the type of 
exposure (eg, bias, flat, standard-star field, or secondary 



patch) . The robot makes use of much of this information, 
as described below. 

4. OBTAINING AND MANIPULATING THE DATA 

In principle, the photometricity monitoring software 
could run on the data-acquisition computer. However, in 
the interest of limiting stress on the real-time systems, 
the photometricity robot runs on a separate machine, ob- 
taining its data by periodic executions of the UNIX rsync 
software^. The rsync software performs file transfer across 
a network, using a remote-update protocol (based on file 
checksums) to ensure that it only transfers updated or new 
files, without duplicating effort. The output of rsync can 
be set to include a list of the files which were updated. 
This output is passed (via scripts written in the UNIX 
shell language bash^) to a set of software tools written in 
the data-analysis language IDL^. 

Virtually all of the image processing, data analysis, fit- 
ting, and feedback to the observer is executed with IDL 
programs in bash wrappers. This combination of soft- 
ware has proven to be very stable and robust over many 
months of continuous operation. In addition, data reduc- 
tion code written in IDL is easy to develop and read. Our 
only significant reservation is that IDL is a commercial 
product which is not open-source. We have responded to 
this lack of transparency by writing as much as possible of 
the robot's function in terms of very low-level IDL prim- 
itives, which could be re-written straightforwardly in any 
other data-analysis language if we lost confidence in or lost 
access to IDL. We have not found the lack of transparency 
to be limiting for any of the functionality described in this 
paper. 

5. CORRECTING THE IMAGES 

Each raw image is bias-subtracted and flattened, using 
biases and flat-field information archived from the most re- 
cent photometric night. How the bias and flat images are 
computed from a night's data is described in Section ^l], 
along with the conditions on which a night is declared 
photometric. 

Because the CCD is thinned for sensitivity in the u 
bandpass, it exhibits interference fringing in the i' and 
z' bandpasses. The fringing pattern is very stable during 
a night and from night to night. The fringing is modeled 
as an additive distortion; it is removed by subtracting a 
"fringe image" scaled by the DC sky level. How the fringe 
image is computed is described in Section |l^. The DC sky 
level is estimated by taking a mean of all pixels in the im- 
age, but with iterated "sigma-clipping" in which the rms 
pixel value is computed, 3.5-sigma outlier pixels are dis- 
carded, and the mean and rms are re-estimated. This pro- 
cess is iterated to convergence. The fringing correction is 
demonstrated in Figure |l|. Although in principle the fring- 
ing pattern may depend on the temperature or humidity 
of the night sky, it does not appear to vary significantly 
within a night, or even night-to-night. Perhaps surpris- 
ingly, the fringing pattern appears fixed and its amplitude 
scales linearly with the DC level of the sky. 

For each corrected PT image, a mask of bad pixels is 



^Information about rsync is available at 'http://rsync.samba.org/". 

''Information about bash is available at the Free Software Foundation at "tittp;//www. fsf.org/'' 



'Information about IDL is available at "http://www.rsinc.com/". 
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retained. The mask is the union of aU pixels saturated 
in the raw images along with all pixels which are marked 
as anomalous in the bias image, flat image, or (for the i' 
and z' bandpasses) fringe image. How pixels are marked 
as anomalous in the bias, flat, and fringe is described in 
Section 0. 

The individual bias-subtracted, flattened and (for the i' 
and z' bandpasses) fringe-corrected image will, from here 
on, be referred to as the "corrected frames" . The corrected 
frames are stored and saved by the robot in FITS format. 

6. ASTROMETRY AND SOURCE IDENTIFICATION 

Hardware pointing precision is not adequate for indi- 
vidual source identifications. The software robot deter- 
mines the precise astrometry itself, b y comparison wit h 
the USNO-SA2.0 astrometric catalog ( [Monet et al 19981 ). 
This catalog contains 5 x 10'' astrometric stars over most 
of the sky; there are typically a few 10^ catalog stars inside 
a FT image. 

In brief, the astrometric solution for each image is found 
as follows: A sub-catalog is created from all astrometric 
stars within 30 arcmin of the field center (as reported by 
the hardware in the raw image he ader). An implemen- 
tation of the DAOFHOT software ( [Stetson 1987| , jstetsoij 
1992) in IDL (by private communication from W. Lands- 
man) is used to locate all bright point sources in the cor- 
rected frame (DAOFHOT is used for object-finding only, 
not photometry). Each set of stars is treated as a set of 
delta- functions on the two-dimensional plane of the sky, 
and the cross-correlation image is constructed. If there 
is a statistically significant cluster of points in the cross- 
correlation image, it is treated as the offset between the 
two images. Corresponding positions in the two sets of 
stars (from the corrected frame and from the astrometric 
catalog) are identified, and the offset, rotation, and non- 
linear radial distortion in the corrected frame are all fit, 
with iterative improvement of the correspondence between 
the two sets of stars. The precise astrometric information 
is stored in the FITS header of each corrected frame in 
GSSS format (this format is not st andard FITS but is used 



dolt 1992) containing multiple standard stars spanning a 



by the HST Guide Star S urvey; cf. [RusseU et al 1990[ |Cal- 
abretta fc Greisen 2000| ). Our algorithm is much faster 



albeit less general, than previous algorithms (eg, Valdes 
et al 1995|) 



Essentially all exposures of more than a few seconds in 
the g\ r' and i' bandpasses obtain correct astrometric so- 
lutions by this procedure. Some short v! and z' exposures 
do not, and are picked up on a second pass using a mini- 
catalog constructed from stars detected in the g' and r' 
exposures of the same field. On most nights, all exposures 
in all bands obtain correct astrometric solutions. 

The algorithm and its implementation will be discussed 
in more detail in a separate paper, as it has applications 
in astronomy that go beyond this project. 

7. PHOTOMETRY 

The robot measures and performs photometric fits with 
the stars in the SDSS catalog of photometric standards 
(Smith et al in preparation). This catalog includes stars in 
the range 6 < r < 15 mag, calibrated with the USNO 40 
inch Ritchey-Chrctien Telescope. Several of the stan dard 
star fields used in this catalog are well-studied fields (Lan- 



range of magnitude and color. 

The photometric catalog is searched for photometric 
standard stars inside the boundaries of each corrected 
frame with precise astrometric header information. If any 
stars are found in the photometric catalog, aperture pho- 
tometry is performed on the point source found at the as- 
trometric location of each photometric standard star. The 
centers of the photometric apertures are tweaked with a 
centroiding procedure which allows for small (^ 1 arcsec) 
inaccuracies in absolute astrometry. The aperture pho- 
tometry is performed in focal-plane apertures of radii 4.63, 
7.43, and 11.42 arcsec. The sky value is measured by tak- 
ing the mean of the pixel values in an annulus of inner 
radius 28.20 and outer radius 44.21 arcsec, with iterated 
outlier rejection at 3 sigma. All of these angular radii are 
chosen to match tho se used by the SDSS FHOTO software 
(Lupton et al 2001, Lupton et al in preparation). 

In what follows, the 7.43-arcsec-radius aperture photom- 
etry is used. This aperture was chosen from among the 
three for showing, on nights of typical seeing, the lowest- 
scatter photometric solutions. This is because, in prac- 
tice, the 7.43-arcsec-radius aperture is roughly the correct 
trade-off between individual measurement signal-to-noise 
(which favors small apertures) and insensitivity to spatial 
or temporal variations in the point-spread function (which 
favors large). The FT shows significant, repeatable, sys- 
tematic distortions of the point-spread function across the 
field of view; a more sophisticated robot would model and 
correct these distortions; for our purposes it is sufficient to 
simply choose the relatively large 7.43-arcsec-radius aper- 
ture. 

Each photometric measurement is corrected for its loca- 
tion in the field of view of the FT. There are two correc- 
tions. The first is an illumination correction derived from 
the radial distortion of the field as found in the precise as- 
trometric solution (Section^. The illumination correction 
is designed to account for the fact that photometrically we 
are interested in fluxes, but the flatfield is measured with 
the sky; ie, the flatfield is made to correct pixels to a con- 
stant surface-brightness sensitivity rather than a constant 
flux sensitivity. Because of optical distortions, pixels near 
the edge of the CCD see a different solid angle than pixels 
near the center. Empirically, the dominant fleld distortion 
appears radial, so no attempt has been made to correct 
for illumination variation from arbitrary distortions. The 
illumination correction reaches a maximum of 0.02 mag 
at the field edges and ~ 0.04 mag at the field corners. 

The second correction is related to the fringing in the 
i' and z' bandpasses. The CCD is thinned, but not pre- 
cisely uniformly; the dominant thinning gradients are ra- 
dial. Because of refiections internal to the CCD, gradi- 
ents in CCD thickness lead to gradients in the fraction 
of point-source light scattered out of the seeing core and 
into the sky level. Since the flat-field is computed on the 
basis of sky level, these gradients are seen as residuals in 
photometry. Radial photometry corrections for the i' and 
z' bandpasses were found by performing empirical fits to 
photometry residuals; they are applied to the i' and z' 
bandpass photometry. These "thinning" corrections reach 
a maximum of [Ai',Az'] ~ [0.02,0.05] mag at the field 
edges and ^ [0.03, 0.07] mag at the field corners. 
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8. CLOUD DETECTION AND DATA VETO 



The "prototype cloud camera" ( Hull et al 1994 ) operat- 
ing at APO utilizes a single-pixel cooled 10 /im detector 
and scanning mirrors. The sky is scanned by two flat mir- 
rors driven by stepper motors, followed by an off-axis hy- 
perbolic mirror that images the sky onto a single channel 
HgCdTe photoconductive detector.^ The detector samples 
300 times per scan, 300 scans per image, yielding an im- 
age with 300 X 300 pixels covering a 135 x 135 deg^ field 
with the 0.9 deg beam. Some typical images are shown in 
Figure ^j. An image is completed in approximately 5 min. 
This is somewhat slow for real-time monitoring, but per- 
fectly adequate for our purposes. This design was prefered 
over a solid state array for reasons of price, stability, and 
field of view. A disadvantage is the maintenance required 
by moving parts, but this has not been a serious drawback. 

Experimentation showed that a simple and adequate 
method for detecting cloud cover is to compute the rms 
value of the sky within 45 deg of zenith in each frame. 
This seems to be a simple and robust method, and it fails 
only in the case of unnaturally uniform cloud cover (this 
has never occurred). When the cloud-camera rms exceeds 
a predefined threshold for a period of time, that period is 
declared bad, and the data taken during that interval are 
ignored for photometric parameter fitting. The bad inter- 
val is padded by 20 min on each end, so that even a single 
cloud appearing in one frame requires discarding at least 
40 min of data. This is conservative, but it is more robust 
to set the cloud threshold high and reject significant time 
intervals than to make the threshold extremely low. 



9. PHOTOMETRIC SOLUTION 

Every time the PT completes a set of u' , g' ,r' ,i' , z' ex- 
posures in a field, the robot compiles all the measurements 
made of photometric standard stars in that night and fits 
photometric parameters to all data not declared bad by 
the cloud-camera veto (Section ||). The photometric equa- 
tions used for the five bandpasses are 



"inst = ■"USNO + au + bu{u- g)vsNO + kuX 
+Cu [X - Xq] [{u - 5)uSNO - (u - g)o] 
+au [t - <o]] 

ft'nst = ffUSNO + Og + 6g (5 - r')uSNO + kg X 

+Cg [X - Xa] [{g - r)usNO - (.g - r)o\ 
+ag [t - to]] 

^inst = ''USNO + ftr + K (r - «)uSNO + ' 

+Cr [X - Xo] [{r - i)uSNO - {r 
+ar [t - to]] 

-f a., + hi {i - 2;)usNO + h X 



krX 

{r-iU 



where the TOi„st symbolize instrumental magnitudes de- 
fined by 

(DN\ 



minst = -2.5 logi 



(2) 



«inst = iuSNO 



with DN the flux in raw counts in the corrected frame and 
toxp the exposure time; the tousno symbolize the magni- 
tudes in the photometric standard-star catalog; X sym- 
bolizes airmass; t symbolizes time (UT); Xq, tg, and the 
colors {u — g)o, etc, symbolize fiducial airmass, time, and 
colors (arbitrarily chosen but close to mean values); and 
the a, 6, fc, c, and d parameters are, in principle, free to 
vary. The system sensitivities are the a^; the tiny differ- 
ences in photometric systems between the USNO 40-inch 
and PT bandpasses are captured by the color coefficients 
bf, the atmospheric extinction coefficients are the fc^; at- 
mospheric extinction is a weak function of intrinsic stellar 
color parameterized by the Ci ; and the di parameterize any 
small time evolution of the system during the night. 

The above photometric equations are not strictly cor- 
rect for an AB system, because in the AB system, there 
is no guarantee that the colors of standard stars through 
two slightly different filter systems will agree at zero color; 
this agreement is assumed by the above equations. In an 
empirical system, such as the Vega-relative magnitude sys- 
tem, a certain star, such as Vega (and stars like it) have 
zero color in all colors of all filter systems. The AB system 
is based on a hypothetical source with f^, = const; there 
is no guarantee that a source with zero color in one filter 
system will have zero color in any other. The offsets must 
be computed theoretically, using models of CCD efficien- 
cies, mirror reflectivities, atmospheric absorption spectra, 
and intrinsic stellar spectral energy distributions. We have 
ignored this (subtle) point, since it only leads to offsets in 
the sensitivity parameters Ui and does not affect photo- 
metricity or atmospheric extinction assessments. 

In practice, the c parameters are always fixed at theo- 
retically derived values 

c„ = —0.021 magmag"^ airmass"'^ 
Cg = -0.016 
= -0.004 
a = +0.006 

Cz = -1-0.003 (3) 

The d parameters are only allowed to be non-zero in the 
next-day analysis (Section ^l]). Because the design speci- 
fication on the PT did not require correct airmass values 
in raw image headers, the airmass values are computed on 
the fly fror n the RA, D ec, UT, and location of the Obser- 
vatory (eg. Smart 1977 ). The reference airmass and colors 
are chosen to be roughly the mean on a typical night of 
observing, or 

Xq = 1.30 airmass (4) 



^mst — 



+di [t - to]] 






{u 


-3)0 = - 


fl.42 


^USNO + CLz 


-bz{i- z)usNO + kzX 




(9 


-r)o = - 


fl.U 


+cz [X - Xo] 


[{i - z)usNO - (« - z)o] 




{r 


- *)o = - 


fO.48 


+dz [t - to]] 




(1) 




- 2)0 = - 


fO.35 



see http://www.apo.nmsu.edu/Telescopes/SDSS/sdss.html 



(5) 
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(in the AB system). In the next-day analysis, the reference 
time Iq is set to be the mean UT of the observations. 

In principle the color coefficients bi could be determined 
globally and fixed once and for all. However, the FT fil- 
ters have been shown to have some variation with time 
and with humidity (they are kept in a low-humidity envi- 
ronment with some variability), so the robot fits them in- 
dependently every night. Freedom of the b.^ is allowed not 
because it is demanded by the data, but rather because 
measurements of the bi over time are an important part 
of data and telescope quality monitoring. Typical color 
coefficient values (which measure differences between the 
USNO 40-inch telescope and FT bandpasses) are 



bu — +0.048 mag mag 
bg = -0.004 
br ^ -0.028 
b, = -0.053 
b, = -0.031 



(6) 



Quite a bit of experimentation went into the photomet- 
ric equations. Inclusion of theoretically determined c pa- 
rameters minutely improves the fit, but on a typical night 
there are not enough data to determine the c parameters 
empirically; the Ci are held fixed. Terms proportional to 
products of time and airmass, again, are not well con- 
strained from a single night's data; they are not included 
in the fit. To each bandpass a color is assigned; the choices 
have been made to use the most well-behaved "adjacent" 
colors. (The {u — g) color is not used for the g equation 
because the boundary between u and g is, by design, on 
the 4000 A break, making color transformations extremely 
sensitive to the precise properties of the filter curves.) 

In the real-time analyses, the a, b, and k parameters (15 
total) are fit to the counts from the aperture photometry 
(and USNO magnitudes, times, airmasses, etc) with a lin- 
ear least-square fitting routine, which iteratively removes 
3.0-sigma outliers and repeats its fit. A typical night at 
AFO shows extinction coefficients 



— 0.52 mag airmass 
kg = 0.19 
kr = 0.12 
h = 0.08 
k, = 0.06 



(7) 



with factor of ^ 1.5 variations from night to night. 

All photometric measurements are weighted equally in 
these fits, because the error budget appears to be domi- 
nated by systematic errors in the USNO catalog and sky 
subtraction; the primary errors are not from photon statis- 
tics. As observing continues and iterative improvement to 
the USNO catalog is made, we will be able to use a more 
sophisticated weighting model; we don't expect such im- 
provements to significantly change the values of our best- 
fit photometric parameters. 

On a typical night, 5-band measurements are made of 
20 to 50 standard stars in 10 to 15 standard-star fields. 



Information about HTML is available at 
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^^Information about ghostscrlpt is available from 
^^Information about the pbmplus package is available from 



10. REAL-TIME OBSERVER FEEDBACK 

Every ten minutes during the night (from 18:00 to 07:00, 
local time), the robot builds a WWW page in Hypertext 
Markup Language^'^^ (HTML) reporting on its most up-to- 
date photometric solution. The WWW page shows the 
best-fit a, b and k parameter values, plots of residuals 
around the best photometric solution in the five band- 
passes, and root-mean-squares (rms) of the residuals in 
the five bandpasses. Farameters or rms values grossly 
out-of-spec are flagged in red. This feedback allows the 
observers to make real-time decisions about photometric- 
ity, and confirm expectations based on visual impressions 
of and lO-fim camera data on atmospheric conditions. The 
WWW page also includes an excerpt from the observers' 
manually entered log file. This allows those monitoring 
the site remotely to compare the observers' and robot's 
photometricity judgements. Figures |^ and ^ show exam- 
ples of the photometricity output on the WWW page on 
two typical nights. 

The WWW page also shows data from the AFO 
weather, dust, and cloud monitors for comparison by the 
observers, as do Figures I and |. 

Since WWW pages in HTML arc simply text files, they 
are trivially output by IDL. The figures on the WWW 
pages are output by IDL as FostScript files and then con- 
verted to a (crudely) antialiased pixel image with the 
UNIX command ghostscript^^ and the UNIX pbmplus 
package^^. 



11. NEXT- DAY ANALYSIS AND FEEDBACK 

At 07:00 (local time) each day, the robot begins its 
"next-day" analysis, in which all the data from the en- 
tire night (just ended) are re-reduced and final decisions 
are made about photometricity and data acceptability. 

Bias frames taken during the night are identified by 
header keywords. The bias frames are averaged, with it- 
erated outlier rejection, to make a bias image. Any pixels 
with values more than 10-sigma deviant from the mean 
pixel value in the bias image are flagged as bad in a bias 
mask image. 

Dome and sky flat frames are identified by header key- 
words. These raw images are bias-subtracted using the 
bias image. Each bias-subtracted image is divided by its 
own mean, which is estimated with iterated outlier rejec- 
tion. The bias-subtracted and mean-divided flat frames 
are averaged together, again with iterated outlier rejec- 
tion, to make five flat images, one for each bandpass. Any 
pixels with values more than 10-sigma deviant from the 
mean are flagged as bad in flat mask images. 

The i and z-bandpass images are affected by an inter- 
ference fringing pattern, which is modeled as an additive 
distortion. Any i or z-bandpass image taken during the 
night with exposure time texp > 100 s is identified. These 
long-exposure frames are bias-subtracted and divided by 
the flat. Each is divided by its own mean, again estimated 
with iterated outlier rejection. These mean-divided frames 
are averaged together, again with iterated outlier rejection 
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to make two fringe correction images, in the i' and z' band- 
passes. Again, 10-sigma outlier pixels are flagged as bad 
in fringe mask images. 

Constant bias, flat and fringe images are used for the 
entire night; there is no evidence with this system that 
there is time evolution in any of these. 

All the raw images from the night are bias-subtracted 
and flattened with these new same-night bias and flat 
images. The i' and z'-bandpass images are also fringe- 
corrected. Thus a new set of corrected frames is con- 
structed for that night. The real-time astrometry solutions 
are re-used in these new corrected frames. All photometry 
is re-measured in the new corrected frames. 

A final photometric parameter fit is performed with the 
new measurements, again with removal of data declared 
bad by the cloud-camera veto, and with iterated outlier 
rejection. The only difference is that the time evolution d 
terms are allowed to be non-zero. 

Because we expect non-zero d terms to be caused by 
changing atmospheric conditions, we experimented with 
allowing time evolution in the extinction coefficients (eg, k 
terms) . Unfortunately, such terms involve non- linear com- 
binations of input data (time times airmass) and can only 
be added without introducing biases if there are *also* 
a terms; ie, it is wrong in principle to include k terms 
without also adding d terms, especially in the face of iter- 
ated outlier rejection. We found that adding both d and 
k terms did not improve our fits relative to simply adding 
d terms, so we have not included k terms. With more fre- 
quent standard-star sampling, the time resolution of the 
system would be improved and k terms would, presumably, 
improve the flts. 

The entire next-day re-analysis takes between three and 
six hours, depending on the amount of data. Much of the 
computer time is spent swapping processes in and out of 
virtual memory; with more efficient code or larger RAM 
the re-analysis time could be reduced to under two hours. 
The re-analysis would take one to two hours longer if it 
were necessary to repeat the astrometric solutions found 
in the real-time analysis. 

At the end of the re-analysis, the robot constructs a "fl- 
nal" WWW page, similar to the real-time feedback WWW 
page, but with the final photometric solution and residu- 
als. Parameters grossly out-of-spec are shown in red. Also, 
the robot sends an email to a SDSS email archive and ex- 
ploder, summarizing the final parameter values and rms 
residuals in the five bands. 

For the robot's purposes, a night is declared "pho- 
tometric" if the rms residual around the photomet- 
ric solution (after iterated outlier rejection at the 3- 
sigma level) in the [u\ g' ,r' ,i\ z'] bandpasses is less than 
[0.03, 0.02, 0.02, 0.02, 0.03] mag. If the night is declared 
photometric, then the bias, flat, and fringe images and 
their associated pixel masks are declared "current," to be 
used for the real-time analysis of the following nights. 

Figure ^ shows the final fits for an example night, with 
and without the inclusion of the veto of data taken during 
cloudy periods. This is a night which would have been 
declared marginally non-photometric without the cloud- 
camera veto, but became photometric when the cloudy 
periods were removed. 



12. ARCHIVING 

All raw PT data are saved in a tape archive at Fermi Na- 
tional Accelerator Laboratory (FNAL) . In addition, about 
one year's worth of the most recent data are archived on 
the robot machine itself, on a pair of large disk drives. The 
photometric parameters from each photometric night are 
kept in a FITS binary table ( [Cotton ct al 1995| ), labeled 
by observation date. These parameter files are mirrored in 
directories at FNAL and elsewhere (DWH's laptop, for ex- 
ample). Because the astrometric solutions are somewhat 
time-consuming, the astrometric headers for all the cor- 
rected frames are also saved on disk on the robot machine 
and mirrored, along with each night's bias, fiat, and fringe 
images. Because the astrometric header information is all 
saved, along with the bias, flat, and fringe images, the cor- 
rected frames can be reconstructed trivially and quickly 
from the raw data. 

13. SCIENTIFIC OUTPUT 

The archived output data from the photometricity mon- 
itor robot is not just useful for verifying and analyzing 
contemporaneous data from the Observatory. It contains 
a wealth of scientific data useful for analyzing long-term 
behavior and pathologies of the site, the hardware, and 
the standard star catalog. Many of these analyses will be 
performed and presented elsewhere, as the site monitoring 
data builds up. 

As an example. Figure o shows the atmospheric extinc- 
tion coefficients [km kg, fc^ [plotted against one another, for 
most of the photometric nights in roughly one-third of a 
year. This Figure shows the variability in the extinction 
coefficients, as well as their covariance. If the variability 
in the extinction is due to varying optical depth of a single 
component of absorbing material, the covariances should 
fall along the grey diagonal lines (ie, ku oc kg oc fc^). Al- 
though the kg vs kr plot is consistent with this assumption, 
the ku vs kr plot appears not to be. Perhaps not surpris- 
ingly, atmospheric extinction must be caused by multiple 
atmospheric components. It is at least slightly surpris- 
ing to us that the variability in u-bandpass extinction is 
smaller than would be predicted from a one-component as- 
sumption and the variability in the r-bandpass extinction. 

14. COMMENTS 

The success of this ongoing project shows that robust, 
hands-off, real-time and next-day photometricity assess- 
ment and atmospheric extinction measurement is possible. 
There is much lore about photometricity, site variability, 
and precise measurement in astronomy. Most of this lore 
can be given an empirical basis with a simple system like 
the one described in this paper. 

It is worth emphasizing that the observing hardware 
used by the robot is not dedicated to the robot's site mon- 
itoring tasks. The PT is being used to calibrate SDSS 
data; it only spends about one third of its time taking the 
observations of catalogued standards which are used for 
photometricity and extinction measurements. This shows 
that a robot of this type could, with straightforward (if 
not trivial) adjustment, be made to "piggyback" on almost 
any observational program, provided that some fraction of 
the data is multi-band imaging of photometric standard 
stars. The robot does not rely on the images having ac- 
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curate astrometric header information, or accurate text 
descriptions or log entries; it finds standard stars in a ro- 
bust, hands-ofF manner. Many observatories could install 
a robot of this type with no hardware cost whatsoever! A 
site with no appropriate imaging program on which the 
robot could "piggyback" could install a small telescope 
with a good robotic control system, a CCD and filter- 
wheel, and the robot software described here, at fairly low 
cost. The telescope need only be large enough to obtain 
good photometric measurements of some appropriate set 
of standard stars. All of the costs associated with such a 
system are going down as s mall, robotic telescopes are be- 
comi ng more common (eg, Akcrlof ct al 1999 , Strassmeiei 
et al |000| , iQuerci fc Querci 20001 ). 

The robot works adequately without input from the 
10 /J,m cloud camera, as long as data are not taken during 
cloudy periods, or as long as the observers can mark, in 
some way accessible to the robot, cloudy data. On the 
other hand, 10 /im pixel array cameras, with no moving 
parts (unlike the prototype camera working at APO) are 
now extremely inexpensive and would be easy to install 
and use at any observatory. 

The robot system was developed and implemented in a 
period of about nine months. It has been a very robust 
tool for the SDSS observers. The rapid development and 
robust operation can be ascribed to a number of factors: 
The robot design philosophy has always been to make ev- 
ery aspect of the robot's operation as straightforward as 
possible. We have only added sophistication to the robot's 
behavior as it has been demanded by the data. The IDL 
data analysis language has primitives useful for astronomy 
and it operates on a wide range of platforms and operat- 
ing systems. Perhaps above all, the PT is a stable, robust 
telescope (Uomoto et al in preparation). 

Without objective, well-understood site monitoring like 
that provided by this simple robot, analyses of archived 
and queue-observing data will always be subject to some 



suspicion. At APO, the visual monitor robot has been 
a very inexpensive and effective tool for building confi- 
dence in observer decisions and for providing feedback to 
data analysis. With this robot operating, APO has better 
monitoring of site conditions and data quality than most 
existing or even planned observatories. 
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Table 1 

Approximate PT bandpass information 
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-200 -100 D IDO 20O 

Fig. 1. — A 512 X 512 pix^ (594 x 594 arcsec^) section of a bias-subtracted and flat-fielded z'-bandpass image from the PT, (top) before, 
and (bottom) after the fringing correction. The two images are stretched identically; in the (top) image, the fringing is roughly 10 percent of 
the baclfground level, peak-to-peak. 
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Fig. 2.— Two example cloud-camera images, taken (top) at 05:24 UT on MJD 51997, and (bottom) at 05:45 UT on MJD 51997. The 
images are displayed at the same stretch and are negatives (bright areas appear dark). The dark silhouettes around the edge are buildings 
and trees near the camera; the APO 3.5-m Telescope is visible in the upper left-hand corner. 
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Fig. 4. — The real-time WWW output created at 11:00 UT on MJD 51997. The red hatched areas are time intervals vetoed by the 
cloud-camera analysis. Rejected points are shown with smaller symbols. 
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Fig. 5. — A comparison of final fits (ie, including a terms) in the five bands, for MJD 51997, with and without the data vetoing by 
cloud-camera. The panels with the red cross-hatching have had data taken during cloudy periods removed from the fit. In most bands, the 
fit is improved when cloudy data are removed. 
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Fig. 6. — Atmospheric extinction coefficients [fcu,A;g,A;r] in the bandpasses, for most photometric nights between MJD 51840 and 

51970, plotted against one another. The grey lines show the relationship (fcu oa kg (x. kr) expected if atmospheric extinction is due to a single 
atmospheric component. 



